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[57] ABSTRACT 

The present invention concerns a parallel multiprocessor- 
multidisk storage server which offers low delays and high 
throughputs when accessing and processing one- 
dimensional and multi-dimensional file data such as pixmap 
images, text, sound or graphics. The invented parallel 
multiprocessor-multidisk storage server may be used as a 
server offering its services to a computer, to client stations 
residing on a network or to a parallel host system to which 
it is connected. The parallel storage server comprises (a) a 
server interface processor interfacing the storage system 
with a host computer, with a network or with a parallel 
computing system; (b) an array of disk nodes, each disk 
node being composed by one processor electrically con- 
nected to at least one disk and (c) an interconnection 
network for connecting the server interface processor with 
the array of disk nodes. Multi-dimensional data files such as 
3-d images (for example tomographic images), respectively 
2-4 images (for example scanned aerial photographs) are 
segmented into 3-d, respectively 2-d file extents, extents 
being striped onto different disks. One-dimensional files are 
segmented into 1-d file extents. File extents of a given file 
may have a fixed or a variable size. The storage server is 
based on a parallel image and multiple media file storage 
system. This file storage system includes a file server 
process which receives from the high level storage server 
process file creation, file opening, file closing and file 
deleting commands. It further includes extent serving pro- 
cesses running on disk node processors, which receive from 
the file server process commands to update directory entries 
and to open existing files and from the storage interface 
server process commands to read data from a file or to write 
data into a file. It also includes operation processes respon- 
sible for applying in parallel geometric transformations and 
image processing operations to data read from the disks and 
a redundancy file creation process responsible for creating 
redundant parity extent files for selected data files. 

30 Claims, 9 Drawing Sheets 
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Fig. 1 
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Fig. 3 



04/20/2004, EAST Version: 1.4.1 



U.S. Patent 



Apr. 7, 1998 Sheet 4 of 9 



y y y 



o 

VI 

c 
b 



< 
CD 



Q 

o 

u 

0) 

a 



Q) 
(0 



c 

0) 

X 

0) 



MM 



0) 

eg 

bJ 



o 

C 

b 



< 

CD 



y y y 



ct: 

Q 

> 
o 

O 

CD 





00 




0) 


0) 


</) 






c 




c 


CP 




cu 






+-> 


ex 


eg 


X 




UJ 






_j 





ii 



Q) 

JQ 
(0 

Q 















a) 




0) 


y> 








c 




c 




c 


0) 








0) 












ex 


CD 


ex 


CD 


ex 




UJ 




LJ 






— 1 




-J 






li_ 




U- 






04/20/2004, EAST version: 1.4.1 



U.S. Patent 



Apr. 7, 1998 



Sheet 5 of 9 



5,737,549 



Fig. 
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Fig. 7 
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METHOD AND APPARATUS FOR A information elements. Furthermore, the concept of pixmap 

PARALLEL DATA STORAGE AND images, which is generally used in the context of 

PROCESSING SERVER 2-dimensional arrays of pixels, is generalized to the third 

dimension. A 3-dimensional pixmap image is therefore 

BACKGROUND OF THE INVENTION 5 defined as a 3-dimensional array of pixels. Pixels are rep- 

Professionals in various fields such as medical imaging, rescDted * * least ODe Datafiles of «y ^ 

biology and civil engineering require rapid access to huge segmented into extents, extents being one-dimensional for 

amounts of pixmap image data files. Today's acquisition one-dmensional files. 2-dimensional for _ 2-dimensional files 

devices such as video cameras, still image cameras, medical and 3^^sional for 3-^nsional file* Extents are the 

image scanners, desktop scanners, graphic arts scanners are 10 parts of a file which may be stnped onto different disks at file 

able to generate huge quantities of pixmap image data. storage time. Data files include the data as well as metadata 

However, existing desktop computers and workstations do associated with the file For example, an image file mcludes 

not offer siifficient storage bandwidth and processing capa- P™?P ^aU.^ <PM*wg various 

bUities for fast browsing and zooming in large pixmap ^ctenstics of the image file, such as its size in each 

images stored on disks and for applying geometric transf or- 15 dimension, the size of its extents in each dimension and its 

mations and image processing operations to large image c f lour P*^' ™ e mctalhc of a compressed ^image file may 

files. Pixmap image data has to be stored, made accessible also a **** mc size bytes of each 

and processed for various purposes, such as fast interactive compressed extent 

panning through large size images, image zooming For Accessing rectangular windows from large image files is 
displaying large size images in reduced size windows, image 20 a frequent operation, image windows are defined as rectan- 
browsing through sequences of independent images, access gular windows containing an integer number of pixels in 
to video sequences and sound streams, extraction and trans- each dimension. Image window boundaries may be located 
formation of given image parts. at any pixel boundary. When an image file is segmented into 
File data may consist of 2-dimensional images (for „ extents, aligned image windows are defined as the subset of 
example aerial photographs), 3-dimensional images (for 25 whose boundaries coincide with extent bound- 
example tomographic scans, video sequences, sets of anes;. 

2-dimensional images), or one-dimensional data of a spe- File storage and access operations are used as a general 

cific media (for example sound, text, graphics). File data term for accessing file data. Such accesses comprise data 

further comprises compressed images, compressed sound or access to image file windows useful for panning purposes 

compressed text File data also comprises one dimensional, and subsampling operations useful for producing scaled- 

2-dimensional and 3-dimensional arrays of elements which down rectangular image windows displayable in reduced 

are of different nature but can be assimilated to arrays of size visualization windows. Both image file window data 

pixels. extraction and subsampling operations require processing 

Various configurations of prior art computers and disks 35 P° wer < # ven m P""* a PP aratus P* 1 ^ P">- 

can be used for storing pixmap images and multiple media cessing power of disk node processors which are described 

data. Single disk systems are too slow to provide the m more detail bclow - 

bandwidth necessary for fast browsing through large images Prior art methods of storing and accessing large sets of 
or for accessing high-quality video image streams. Disk pixmap image files are based on high-performance work- 
arrays such as redundant arrays of inexpensive disks, known ^ stations accessing arrays of disks. They do not offer the 
as RAID systems [ECHEN90], can be used to increase the means to control the distribution of image file parts onto the 
data bandwidth between mass storage and CPU, but a single disks. Furthermore, the workstation's CPU does not offer 
CPU driving a disk array does not offer sufficient processing sufficient processing power to scale down large image files 
power to apply the image access and processing operations at high-speed in order to display them in limited size 
required for example for panning with a limited size visu- 4 $ visualization windows or to apply to them geometric trans- 
alization window through large images, for displaying formations such as rotations. Hie presently invented data 
reduced views of large images in limited size visualization storage apparatus is based on disk nodes, each disk node 
windows or for applying transformations to given image being composed by one processor electrically connected to 
parts. at least one disk. An array built of such closely coupled 
I — The presently invented multiprocessor-multidisk storage 50 P roccssorHji&k: nodcs offcrs °°th high disk throughput and 
/ server presents a cheaper and more powerful alternative for highly usable parallel processing power. The invented par- 
/ storage and processing of large files such as 2-d and 3-d ^ mt storage and access method described below pro- 
/ pixmap image files, video sequences, sound, text and com- yi(lcs efficient distribution of files onto disks and high-speed 
I pressed media data (images, video, sound and text). It may access t0 requested file windows. 
I be used as a local network server, as an ATM broadband « 

I SD^<i!^p^Sd «J^a^W " SUMMARY OF THE INVENTION 

puter or as a storage server For a parallel system. The present invention concerns a parallel multiprocess or- 
For the description of the invention, the following tenni- multidisk storage server which offers low delays and high 
nology is used. The invented server architecture has been throughputs when accessing one-dimensional and multi- 
created primarily far the storage of image data. Therefore, 60 dimensional file data such as pixmap images, text, sound or 
the underlying parallel file system is explained by showing graphics. Multi-dimensional data files such as 3-d images 
how image files are stored and accessed. Nevertheless, the (for example tomographic images), respectively 2-d images 
concept is more general, and data files which are not images (for example scanned aerial photographs) are segmented 
can also be stored, accessed and processed on the invented into 3-d, respectively 2-d file extents, each extent possibly 
storage server. The mining of pixels is generalized to 65 being stored on a different disk. One-dimensional files (for 
information elements composed of a given number of bytes. example sound or text) are segmented into one-dimensional 
The meaning of pixmap images is generalized to arrays of extents. 
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The invented parallel imimprocesscf-miiltidisk storage 
server may be used as a server offering its services to a 
computer to which it is connected, to client stations residing 
on a network to which it is connected, or to a parallel host 
system to which it is connected. 

The parallel storage server comprises 

(a) a server interface processor interfacing the storage 
system with a host computer, with a network or with a 
parallel computing system; 

(b) an array of disk nodes, each disk node being composed 
by one processor electrically connected to at least one 
disk; 

(c) an interconnection network for connecting the server 
interface processor to the array of disk nodes. 

The parallel storage server runs a server interface process 
expecting serving requests firom client processes, a file 
server process and extent server processes responsible for 
data storage and access as well as additional processes 
responsible for geometric transformations and image pro- 
cessing operations, for creating redundancy files and for 
recovering files in cases of single disk crashes. 

The storage server is based on a parallel multi- 
dimensional file storage system, This file storage system 
incorporates a file server process which receives from the 
storage server interface process file creation, file opening, 
file closing and file deleting commands. It also incorporates 
extent serving processes which receive from the file server 
process commands to update directory entries and to open 
existing files and receive firom the server interface process 
commands to read data from a file or to write data into a file. 
It further incorporates operation processes responsible for 
applying in parallel geometric transformations and image 
processing operations to data read from the disks. It also 
incorporates redundancy file creation processes responsible 
for aeating redundant parity extent files for selected data 
files. 

When acting as a host backend server, as a network server 
or as a parallel computer storage server, the server interface 
process ru nnin g on the server interface processor receives 
data access and processing requests, interprets them and 
decomposes them into file level requests (for example 
creation, opening, reading, writing and deleting) or into file 
operation requests (for example geometric transformations, 
image processing operations). In the case of read requests, 
the file system interface library decomposes these requests 
into extent read requests and transmits them to the extent 
server processes. It waits for the required extent data from 
the disk nodes, assembles it into the required data window 
and transmits it to the server interface process which for- 
wards the data to the client process located on the client 
computer. 

When attached to a parallel host system, the storage server 
made of intelligent disk nodes interacts directly with host 
processes running on the parallel system. Host processes 
may simultaneously access either different files or the same 
file through the file system interface libraries and ask for 
arbitrarily sized data windows. 

Extent serving processes running on disk node processors 
are responsible For managing the free blocks of their con- 
nected storage devices, for maintaining the data structure 
associated with the file extents stored on their disks, for 
reading extents from disks, For writing extents to disks, and 
for maintaining a local extent cache offering fast access to 
recently used data. At image access time, extent server 
processes are responsible for accessing extents covered by 
the required visualization window, extracting the visualiza- 
tion window's content and sending the extent windows to 
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the storage server interface processor. In the case of a 
zooming operation, the extent server processes subsample 
the original data in order to produce an image at the required 
reduced size. Disk node processors may run slave operation 
processes used for applying geometric transformations such 
as rotations or other image processing operations to locally 
retrieved image parts. 

The invented parallel file storage server distinguishes 
itself From the prior art by the Following features: 

(1) its file storage system runs on a multiprocessor- 
multidisk platform and offers 2-d and 3-d image storage 
and access services requiring simultaneous disk 
accesses and processing operations such as high-speed 
panning and zooming in sets of large images; 

(2) it comprises information about file sizes in each 
dimension, about how files are segmented into 

1 - dimensional, 2-dimensional or 3-dimensional extents 
and about how extents are distributed on a subset of the 
available disks; 

(3) it provides library procedures for parallel application 
of geometric transformation and processing operations 
to data striped on multiple disks; 

(4) disk node processors combine parallel file extent 
accesses from disks and application of the required 
geometric transformation and processing operations. 

The invented parallel file storage server is Further char- 
acterized by the Following Features: 

(1) it offers services for creating multidimensional (1-d. 

2- d, 3-d) image and multiple media Files in addition to 
conventional files; 

(2) it comprises a file server process responsible for global 
operations such as file creation, file opening and file 
deleting; 

(3) it comprises extent server processes responsible for 
accessing extents stored on their local disks, for man- 
aging a local extent cache and for interacting with the 
file server to create or delete directory entries; 

(4) it comprises operation processes running on disk node 
processing units capable of applying geometric trans- 
formations or image processing operations in parallel to 
image parts read from the disks, thereby speeding up 
processing time by a significant Factor, 

(5) it comprises redundancy file creation processes 
capable of generating redundancy Files From given 
data files; 

(6) it comprises a recovery process capable of recovering 
files in cases of single disk crashes. ■ 

The invented parallel image and multiple media server 
offers the following advantages over the prior art: 

(1) disk node processing units are located close to the 
disks enabling disk file accesses and processing opera- 
tions to be closely combined (for example pipelined); 

(2) the number of disk node processing units and of disks 
attached to each disk node processing unit can be 
independently chosen and adapted to the requirements 
of an application; 

(3) due to the fact that the parallel server knows about the 
dimensionality of an image file and about its access 
patterns (Le. for example access to rectangular win- 
dows in large image files) and mat the parallel file 
system supports multi-dimensional files segmented into 
multi-dimensional extents, it is able to segment the file 
into extents in such a way that file parts are accessed on 
a nniltiprocessc*-multidisk system in a more efficient 
way than with a conventional file system using a RAID 
disk array as its storage device; 
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(4) Since extents of compressed image files are indepen- crossbar switch. The interface processor is either connected 

dently compressed and since the parallel file system to a host station 11, preferably through a SCSI-2 target 

supports the storage of extents having a variable size interface 17 or directly connected to a network 19 with a 

within the same file the advantages mentioned in point network interface such as Ethernet FDDI or ATM broad- 

(3) apply also in the case of compressed image files. 5 band ISDN. 

The server interface processor offers the client computer 

BRIEF DESCRIPTION OF THE DRAWINGS or remotel^Llocated client stations, its services which com- 
HG. 1 is a block diagram fllustrating an example of a m * me access * ^ transformation file pro 
parallel image and miiitiple media server. <* ssin g ** d me recovery operations. File storage and access 
™^ ZT^ , c . , ^ io services are offered by the underlying parallel file system. 
FIG. 2 shows an example of services running on interface ^ ^ mc ^ comprises a mc server process 23 
processor 28 and on disk node processors 29. running on any one of the processors, for example the 
FIG. 3 shows an example of a server interface process interface processor 28, and extent server processes 24 run- 
interacting with a client process and with the file system's ^ mc DO de processors 29 (FIG. 2). As shown in 
file and extent server processes. 15 FIG. 3, the file server process 33 receives from the server 
FIG. 4 gives a preferred embodiment of the disk layout of interface process 31 interface library 32 file creation, file 
the parallel file system's data structures. opening and file closing commands, and interacts with 
FIGS. 5a, Sb and 5c give examples showing how extent server processes 34 to create new file entries in the 
1-dimensional, 2-dimensional and 3-dimensional files are D/rectory and in the Distribution index Block Table 
segmented into extents. 20 described below. Extent server processes run on the disk 
FIG. 6 gives examples of how extent sizes influence the lesson 29 and receive commaiKls either from die 
distribution of extents to disks: a well chosen extent size is ^ server process 23 or from the server interface process 21. 
shown in FIG. 6a which provides quite uniform extent W* P™*^ which run extent server processes 
access patterns within a given visualization window and a „ 24 *™ °P era * on t™**™ 27 are used for r^el file 
badly chosen extent size is shown in FIG. 6b which induces 25 storage and access Junctions, for extracting in parallel visu- 

a non-balanced extent access pattern. ™*Z»* ** d for ™ 

w ^ „ . , , . ^ geometric transformations or image processing operations to 

HG. 7 shows an example of a 3-dimensional window 70 j> ^ ^ from ^ ^ 

located in a 3-dimensional image file. rJL are members of a pool. As shown below, the pool 

FIGS. 80 and 9b give example of a 2-dimensional image 30 membership of a disk can be identified by analyzing its 

file segmented into extents striped onto 5 disks, covered by oisklnfo field located in the first blocks of the disk, 
a 2-dimensional file window 81. 

FIG. Sb shows that extent windows 82 have to be Prcf M of me stIucturcs cn ^ 

accessed from the disks in order to obtain all extent parts The parallel file system uses the following preferred data 

covered by the 2-dimensional window 35 structures for the layout of information on the disks and for 

FIGS. 9a, 9b and 9c show an example of a file providing easy and quick access to files striped on multiple 

transformation, where a rectangular window covered by disks ff 10 - 4). In the first part of each disk, a disk infor- 

several extents is to be rotated by a specified rotation angle. s*"*^ 4 ] J^J* 0 rontain f mc 

identifier, the size of the disk, its type, the name of the disk 

DETAILED DESCRIPTION OF THE 40 pool it belongs to, the disk's logical number within the pool 

PREFERRED EMBODIMENTS and pointers 42 to the Block Allocation Table (BAT)* to the 

Directory (DIR) and to the Distribution Index Block Table 

Current apparatuses for storing, accessing and processing (DIBTabie). The second part of each disk contains the Block 

of image data are based on workstations connected to RAID Allocation Table (BAT) 43 made of a bitmap, where each 

disk arrays [Chen90]. RAID disk arrays connected to single 45 block of the disk is represented by one bit, this bit being 0, 

processor workstations do offer higher storage capabilities respectively 1 depending on whether the corresponding 

as well as a higher throughput than single disks. However block is free, respectively allocated. The third part of each 

RAID disk arrays do not ^corporate processing power for the Directory (DIR) 44. Each entry in the 

performing image scaling operations, image window extrac- directory contains one file name and a pointer to the corre- 

tion operations, image transformations or image processing ^ sponding Distribution Informaticm Block (DIB) in the Dis- 

operations. Such operations must be executed by the host tribution Information Block Table. The fourjj^partj>f_each 

processor. disk contains the Distri bution Inf ormation Block T able 

The invented parallel storage server apparatus (FIG. 1) ( DIBTable) 45. Each table entry is associated w ith one 

presents a cheaper alternative to image and multiple media Director y entry. An entry in the Distribution Information 

storage devices based on workstation and RAID disk arrays. 55 Block Table conta^ information which is generally fou nd 

It includes a server interface processor 12 intafacing the in ina1cTT 5 o*9cr^ and file image relate d 

storage system with a client computer U (host computer) or iWnrnMri q n _sucfa_asj he.imag €_ size in each dim ension, the 

with a network 19, an array of intelligent disk nodes 18, each e xtenTsizeTiiLeac fa di mension, Jd he munber of disks used, b y 

disk node being composed of one processor 13 and at least specified file, a disk table, specifying the disk identifi ers 

one disk 14. and an interconnection network 16 for con- go of the used.disks.and, .fo r_each .u sed_dis>u a pointer 46 to a 

necting the server interface processor to the array of intel- File*Local Extent Index Table (FLETB). The DIB also 

ligent disk nodes. contains a field for descnbih^aiKl^>ointing 47 to optional file 

The server interface processor 12, the interconnection metadata 48 (colour palette, size of compressed file extents), 

network 16 and the disk node processors 13 are made of This field specifies the disk where the metadata is located, 

ooinmcrcially available components, such asT800 orT9000 65 the metadata size in bytes and the first block on which 

transputers, communication links and possibly a communi- metadata is stored. Metadata is stored in continuous disk 

cation crossbar switch like the Inmos C104 transputer link block locations. 
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Space for the Block Allocation Table (BAT), toe Directory The difference between an extent number and the extent 

(DIR) and the Distribution Index Block Table (DIBTable) is number one row below it can be varied by changing the 

allocated at pool initialization time. The Disklnfo, BAT, DIR extent size in the horizontal direction (extent width). Reduc- 

and DIB disk spaces are replicated on each of the disks of ing respectively enlarging the extent width increases, 

the pool. This enables information about the pool to be 5 respectively reduces the difference between extent numbers 

recovered from any disk. At pool initialization, the file of extents lying one below the other. As an example. FIG. 6a 

server process initializes its list of directory entries. For each incorporates a file with 1 1 extents per extent row and FIG. 

file there is File Local Extent Index Table (FUBCB) on each 6b a file with 12 extents per extent row. According to 

disk on which the file is striped. The FLEIB table includes equation (2), reduction or enlargement of extent width 

for each locally stored extent a pointer to its starting disk 10 makes it possible to change the offset between the disk 

block and the effective extent size in bytes. Extents are number of extents lying one below the other. FIG. 6a shows 

stored in continuous disk block locations. an example of a well chosen extent size where the disk offset 

At flic creation time, a directory and a DIB entry and, on i ' 2f<x9 .^' nG '^^ 

each contributing disk, a file local extent index table «tent size where the disk^offsetis 3 for 9 dub thus not 
Sum are «2ed. At file writing time, disk blocks are is fulfilling the condition mentioned in formula (3) ; 
Sfo^tent to be written on that disk THe Experiments and simulations have shown that for disks 

SotSSS^^of^it on the disk is having a throughput of 1 to 3 Mbytes per second, an extent 

, a V\u _ . rtf tllA ct err, tflWp size should be chosen so as to contain an amount of data 

placed at the corresponding location of the FLEIB table. 50 Kbytes and 150 Kbytes. For image files, the size 

Segmentation of image files and disk striping 20 in bytes of an extent is obtained by multiplying the pixel size 

c ^ method io bytes by the extent dimensions in all present dimensions. 

For example, the size of a 3-dimensional extent is computed 
FIGS. 5a, 5b and 5c show examples of one-dimensional, as follows: 

2- dimensional and 3-dimensional image files segmented 

into one-dimensionaU 2j^onal and 3^ensional 25 E ^ MnByt ^^ 
extents. Extents are numbered first in the x direction, then in NumbcrOfBytcsPwPixtL 
the y direction and then in the z direction. For example, a 

3- dimensional extent positioned as the ith extent in the x The file server process enables the initialization a disk 
direction, the ith extent in y direction, and the kth extent in pool made of a freely chosen number of disk nodes and of 
z direction gets the following ExtentNumben 30 a number of disks per disk node ranging between 1 and 7 or 

between 1 and 15 depending on the type of SCSI bus 
interface used. It enables the creation of one-dimensional, 
BxteaiNumberfcj^)=k»(Nqmb^ 2-dimensional or 3 -dimensional files by specifying their 

j*NbOfExteatslnX+i (1) final size in each dimension, their pixel size in bytes, their 

. ^ 0< extent size in each dimension, the fixed size or variable 

where NbOfExtentsInX and Nunn^erOfExtentsIlnY are the 35 extcQt ^ modc in the file is to be created, the size 
number of extents required to cover respectively the width toberaBve4to inetadata, me number of disks 

(x-axis) and the height (y^xis) of one plane of the consid- ^ ^ ^ ^ &c idcDtmes of the contribut- 

ered 3-d pixmap image. FIGS. 5a, 5b and 5c give examples ^ ^ ^ ^ ^ ^ to obtain ^ pesfosm&DCes ^ 

of how extents are numbered. & d ^ fo a -yen mc ^ striped snould preferably 

Extents are striped onto a subset of the Asks available 40 ^ oodes . *~ 

within the disk pool (contributing disks). The number of 

contributing disks (NumberOfDisks parameter) as well as Parallel file system interface library procedures 

the disk identifiers on which the file is stored are specified ^ scryer interface process 21 accesses the functions 
at file creation time. offered by the parallel file system through library procedures 

The extents are striped according to their extent number 45 of Ac mte rface library 22. There is a library procedure for 
on the contributing disks, as specified by the following orating a file of a givcasizejn^ 

formula: extent size .to each dimensio n. This file creation library 

procedurc^t ransmits the nlejcre atipn^cornmand to the file 
server oroccss, which finds a free entry in it s director y entry 

DiakNumbo(ExB^imibcr>^to^uiiLbcr MODULO Number- 50 "^sJ^^ . . 

iw^i^^un^^ (2) xist, and towards th e flle_ creatipnje^ue^to^exjenLserver 

processes, specifving the directory ent^jiumber of the new 
At file creation time, any extent size having an integer fileU N 
number of pixels in each dimension can be chosen. Extents a library procedure exists for reading a 1 -dimensional 
may cover a larger space than the space containing the image ^ 2-dimensional or 3-dimensional pixmap image window 
file information (see FIG. SA, SB andSC). In order to obtain from an existing file. The pixmap image window read from 
a balanced distribution of extents within a given image the 'file covers a freely specified window of the full file 
visualization window, the DiskNumber of one extent 61 and space. In order to read a window from an image file striped 
the diskNumber of the extent located one extent row below on several disks, the reading procedure performs the fol- 
62 should have a difference (disk offset) which is prime to ^ lowing steps: 

the number of disks (FIG. 6A and 6B). Expressed ^ [ t computes the number identifying every extent 
mathematically, the greatest common denominator of the contributing to the required image file window; 

absolute value of this difference and the number of disks (2) for every contributing extent, it computes the part 
should be one: covered by the required image file window 81 (extent 

6s window); 

CKD^^ < 3 > * . <3 f k ° f COntribUtiD8 

Nanbcxt^lJiXNuiDbcfOfi^akBH P) extent according to formula (2), 
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(4) from the disk ta bic stored in the DIB, it com putes the The library procedure sends_complctc_exteat_mi{ing 
dis k identifier of each disk numb er; re quests to the extenLseryer processes. Bxtent server pto- 

(5) fo r each requested extent, it sends an e xtent window c esses allocate the disk blocks required for writing their 
re ad request to the extent server runnin g on the disk extents, write their extents on these blocks.and u pdate the 
no de connected to the disk storing the e xtent; 5 corresponding FLETB table entries. A similar lihn»y pmrft. 

(6) it receives the required extent windows from the J« ^UP^I^ 
exte fltservers- — ~" disks^g_an^gned>wuidow-i&>requested Jxy. .the, reading 

~~ . . 1 . . , procedure f .oiily4he.complete^ext^^ 

(7) it assembles all extent windows into the required w^w arc re quested from extent server processes. 
image file window-and returns it to the callin g program. 1Q - ~ — 

er ~Alibrary procedure for writing an image file window into Applying operations to file data striped onto disks 

a previously created image file exists and works similarly to One of the advantage s of t he inve nted multiprocessor- 

the image file window reading procedure, with the difference mumdisk server is i ts inherent ab ilitvito perform in parallel 

m at extent wiiid QWS.are.s ent to t faeextent servers, that ex tent op ^oET oTdato read from the d isks. The server comprises 

servers must access t heir disks tojeadjhejgmplete corre- 15 an operation master pio ccss26 1oca ted in the server inter- 

sponding extents, write into them the extent windows and face prc^oF2«^ " bc^ation slave processcl27~ locate d 

writcback.the.CQmplete extents to the disk s. on n0 ffc p rocessin g units 29 . The server interface 

A library procedure exists for accessing andscaling-down ocess may require a n operation to be applied to a g iven 

an imagejl ejwindow into a smaUerw indow (zooming):The ^ It transmits to the operation master process the name of 

IK^ocedure works inaamto ^ the file, parameters s pecifying the type of the operation to be 

reaamg procjedu re. the onl y difference being.that the con- performed , me date domai n (for example, the image file 

^t^g-^nLseryers^r^asked to subsample tnehyextent window) on whic h it is to be perfor med and the form in 

win dow obt ained fr om the disks and to sen d the subsampl ed w hich.the-re*ult s_are to be gjyen~bac£ ~ — 

extentwind^^ all ^ M a^^f ^ operation, the rotation of oblique 

subsampled^ntjviiu^^ ^ rectangular windows lying in 2-dimensional pixmap images 

inia^winiaw. is described The server interface process specifies to the 

- Library procedures exist for reading and writing ahgned undcrlyillg master operation process an oblique rectangular 

image windows. Since aligned image windows.are aligned win^ ^thhi a given image file. The rotating task consists 

with extent^ todaries,jfoe proc^res^eract_with the of TOt ^ ng ^ • c m lying within the specified rectan- 

extenuerwrro^^ 30 gular window by a certain rotation angle so that its sides 

extents^lnjhie^^ in variable ex tent size ^ me horizontal and vertical axes. The 

mofc^ues^sjfc^^ mas ocess ^ c^esponding file and gets its BE* 

ctejs-spccifyingjk^ SiauOarly a request for Wth mc information in the DIB. it computes which arc the 

reatogjxn^lcu^ of me CQVmd by &c rcct angular window. It also 
c *£M^ nt * . . o ... .33 computes the continuous boundary of the oblique rectangu- 

UT^ procedures exist forwnting and reading metadata laf window ^ cxtcnL rac rea ding and operation 

from files There are also library procedures for dosing a commands m Usmsnsitx&d to the slave operation processes 

file, for deletuig a file and for listmg Uie^pre^entui the res iding on the disk node processors. Bach slave operation 

—directory (gp). process is as^Jo,read_thosee^nts_contn^uting to the 

Further library procedures exist for wn^g^d reading ^ oblique rectangular Wo w^hich arc stored^nj^^disks 

^^^J^jQT^lym op^o^ on file data for con^J^iiilikk node processor. Slave operation po- 

crea^ r^ndan^Jles and for the rcco^gy^of filcgjrom cesscTn^als^re^lo^o^ixel lines or columns from 

a s^^disXcra^ The funcUons executed b y MttgseKbrary neighbouriBg extents in order to be able to perform resanv 

prcctidures are dcCTbed m description which follows. pling md interpolation operations at their extents' boundary. 

Storage of compressed image files 45 » * ^l?J*f concerned 

^ j. » extent consists of rotating by the required rotation angle the 

^-The invented storage server also stores compress ed image continuous boundary obtained by intersecting the extent 

files. The content of each image file extent is sep arately boundary 91 with the oblique window boundary 92. This 

compressed, preferably at the client location. A compressed rotated boundary contains the contribution of the current 

image file contains metadata whi ch s pecifies the compressed so extent to the whole rotated window 93. A target pixmap 94 

_s izg in bytes of each exte nt. The file system supports the circuniscribing said rotated boundary is defined by its width 

storage of extents having a variable, size. When a file is 96, height 97 and by the relative position 98 of said rotated 

created in variable size extent. mode, the DIB will contain boundary. This target pixmap is scanned pixel by pixel 

information relative to the corresponding uncompressed file scanline by scanline by the slave operation process. Pixels 

(image size, extent size, number of disks, disk table). In the 55 whose pixel centers are hying outside the rotated boundary 

same way as for uncompressed image files, FLEEB tables are are set to 0 (black). The position in the non-rotated original 

generated at file creation ti me. In variable size extent m ode, pixmap file extent corresponding to a pixel center lying in 

one set of contmuous^ ^k blocks is allocated d ynamically the target pixmap inside said boundary is found by inverse 

whelO~cornpressed^xtent is to be written to a disk. The rotation or by an equivalent incremental operation 

Mock addr ess^of jte writte n extentTis stored in die corre- 60 [Hersch85]. In order to compute its intensity, bi-linear 

spondingFL^g t able entries. Ea ch FLETB entry also con- interpolation is applied to the intensities of its 4 direct 

tains a fieldspeHfying the effective compressed extent size neighbour pixels in the non-rotated pixmap file extent Once 

in bytes. A library procedure exi sts for wri ting a impressed the full target pixmap has been scanned and one value 

image file to_a_file previously, created in variable extent associated with each pixel, it is sent to the master operation 

mode, the parameters to be transferred by the server inter- 65 process together with the parameters specifying the vertices 

face process are a table specifying for each compressed of said rotated boundary and specifying the location of a 

extent its size in bytes and a pointer to its memory, location. specific bitmap position (for example the upper-left pixel 
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center) in the global image coordinate system. The master 
operation process receives the resulting target pixmaps from 
all contributing slave operation processes. It assembles the 
resulting rotated window subparts by superposing the target 
pixmaps associated with each of the contributing extents. It 
transmits the resulting rotated window to the requesting 
server interface process. Since all disk-node processors 
which have extents covered by the specified oblique window 
contribute in parallel to the window rotation process, the 
result is obtained in a much shorter tune than if this 
operation had been done on a workstation hooked to a RAID 
disk array. 

Redundancy 

Existing RAID redundancy methods [Chen90]require 
generating redundant disk blocks for every file writing 
operation. Writing operations are slowed down and disk 
space is required for storing the redundancy information, 
even if the data to be made redundant is already backed up 
in archive memory. 

The invented storage server comprises a cheaper alterna- 
tive and a more flexible redundancy scheme. At first, data 
files are stored without any redundancy. On request, a 
background redundancy file creation process is run to create 
for each specified data file one redundancy file. Each redun- 
dancy file is stored on different disks than its corresponding 
data files. Thanks to the parity extents generation method 
described below, data files for which redundancy files have 
been generated can be recovered in the case of single disk 
failures. This redundancy scheme works due to the fact that 
a data file can be striped onto a specific subset of the disks 
of the pool, allowing its redundancy file to be stored on a 
complementary disk subset of the pooL 

The redundancy file contains one parity extent for each set 
of subsequent extents of the original file striped into different 
disks. Let us assume that a data file is composed of k extents 
striped over d disks. The first parity extent of the redundancy 
file is obtained by computing for each of its bytes the parity 
of the corresponding bytes from the first d data file extents 
0 to d-1. The so-generated parity extent is the first extent of 
the redundancy file. The jth parity extent is obtained from 
data file extents j»d to (j*^)^- 1 - T ^ iC redundancy file 
contains k+d-1 DIV d parity extents stored on a set of disks 
on which no extent of the original data file has been stored. 

The invented redundancy scheme enables data files to be 
recovered in the case of single disk crashes. It has the 
advantage of being optional thus saving disk space by 
avoiding the creation of redundancy files in the case of data 
files already saved on archive devices. Furthermore, since 
the redundancy files arc separated from data files, they may 
be generated by a background redundancy file creation 
process 20 active only during the idle time of the storage 
server. 

File recovery requests in the case of single disk crashes 
are executed by a file recovery process 25 locating the failed 
disk, opening the data file and its corresponding redundancy 
file, reading for each set of data extents stored on different 
disks those extents stored on valid disks as well as the 
corresponding parity extent, computing from corresponding 
data extents and parity extents the extents located on the 
failed disk and transmitting the recovered file to the request- 
ing process or storing it on a set valid disks. 

While the invention has been described with reference to 
a preferred embodiment thereof, it will be understood by 
those skilled in the art that various changes in form and 
detail may be made without departing from the scope and 
spirit of the invention. 
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What we claim is: 

1. A storage and processing server computing system 
apparatus for offering processing services including: parallel 
file storage, access, and processing functions, comprising: 

(a) a server interface connected by a communication 
means to at least one computer, 

(b) disk nodes, said disk nodes each comprising a disk 
node processor and at least one disk: 

(c) an interconnection network between said server inter- 
face and disk nodes whereby: said server interface is 
operable for receiving service requests from computers, 
further operable for analyzing, processing and decom- 
posing service requests into storage, access and pro- 
cessing commands and further operable for transmit- 
ting them to said disk node processors which are 
operable for receiving commands, further operable for 
executing commands and further operable for returning 
results, whereby an operation is selected from the 
group of geometric transformations and image process- 
ing operations. 

2. The storage and processing server apparatus defined in 
claim 1, wherein service requests from remotely located 
client computers corriprise 

(a) 1-dimensional, 2 -dimensional and 3-dimensional file 
storage and access requests; 

(b) file transformation and processing requests; 

(c) redundancy file creation requests; 

(d) file recovery requests; wherein 

(i) file storage and access requests comprise file 
creating, opening, and deleting commands and file 
extent storage and access commands executed in 
parallel by disk node processors; 

(ii) file transformation and processing requests are 
decomposed into file part transformation and pro- 
cessing operations executed in parallel by disk node 
processors; 

(iii) redundancy file creation requests are executed by 
generating from data file extents parity file extents 
which are stored on different disks from the disks 
storing the corresponding data file extents; 

(iv) file recovery requests in the case of single disk 
crashes are executed by reading valid data extents 
from the file to be recovered and redundant parity 
extents from its corresponding redundancy file, by 
computing the lacking data extents and by writing 
the recovered file on valid disks. 

3. The storage and processing server apparatus defined in 
claim 2, wherein file storage and access requests comprise 

(a) file window storage and access commands, decom- 
posed into extent window storage and access com- 
mands executed in parallel by disk node processors; 

(b) scaled-down file window storage and access 
commands, decomposed into scaled-down extent win- 
dow storage and access commands executed in parallel 
by disk node processors; 

(c) file aligned window access commands, decomposed 
into complete extent storage and access commands 
executed in parallel by disk node processors. 

4. The storage and processing server apparatus defined in 
claim 3, where aligned window access commands are 
decomposed into variable size extent storage and access 
commands executed in parallel by disk node processors. 

5. The storage and processing server apparatus defined in 
claim 2. wherein file transformation and processing opera- 
tions comprise rotation operations executed in parallel by 
disk node processors. 
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6. A parallel file storage, access and processing method 
comprising the steps of 

(a) receiving storage, access and processing requests from 
a client process; 

(b) decomposing rile storage, access and processing 
requests into a plurality of access, storage and process- 
ing requests executable by disk node processors: 

(c) sending said plurality of access, storage and process- 
ing requests to disk node processors: 

(d) receiving in parallel said plurality of access, storage 
and processing requests by disk node processors; 

(e) executing in parallel said plurality of requests includ- 
ing an operation selected from the group of geometric 
transformations and image processing operations by 
accessing disks block on a plurality of disks and by 
applying processing operations executed by a plurality 
of processors; 

(f) assembling the results obtained by the parallel execu- 
tion of said requests into one result: 

(g) returning said result to the requesting client process. 

7. The parallel file storage, access and processing method 
defined in claim 6, wherein files are multidimensional files 
made of elementary elements, each element being composed 
of at least one byte, wherein multidimensional files are 
segmented into multidimensional extents, wherein extents 
are incrementally numbered as is shown in the case of the 
following 3-dirnensional extent positioned as the ith extent 
in the x direction, the jth extent in y direction, and the km 
extent in z direction according to the formula 



j*NbOffixtenlsInXH 
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wherein extents are striped into a set of available d disks 
according to the following formula 
DiskNumberCExtentNuir^ MODULO 
d, 

where NbOfExtentsInX and NbOfExtentsInY are the num- 
ber of extents required to cover respectively the width 
(x-axis) and the height (y-axis) of one plane of the consid- 
ered 3-d pixmap image. 

8. A nmitqjn^sor-multidisk storage server offering par- 
allel file storage, access, and processing functions compris- 
ing: 

(a) a server interface comprising at least one local pro- 
cessor connected by a communication means to at least 
one computer, 

(b) disk nodes, said disk nodes each comprising a disk 50 
node processor and at least one disk, said disk being 
operable for storing data; 

(c) an interconnection network between said server inter- 
face and disk nodes, whereby: said server interface is 
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It. A multiprocessor multidisk storage server of claim 8. 
where the number of disk nodes and the number of disks per 
disk node can be independently chosen according to the 
requirements of the client application. 

11. A multiprocessor multidisk storage server of claim 8. 
where aligned window access commands are decomposed 
into variable size extent storage and access commands 
executed in parallel by disk node processors. 

12. A multiprocessor multidisk storage server of claim 8. 
where file transformation and processing operations com- 
prise rotation operations executed in parallel by disk node 
processors. 

13. A multiprocessor multidisk storage server of claim 8 
where file storage and access requests comprise: 

(a) file window storage and access commands, decom- 
posed into extent window storage and access com- 
mands executed in parallel by disk node processors; 

(b) scaled-down file window storage and access 
commands, decomposed into scaled-down extent win- 
dow storage and access commands executed in parallel 
by disk node processors; 

(c) file aligned window access commands, decomposed 
into complete extent storage and access commands 
executed in parallel by disk node processors. 

14. A parallel file storage, access and processing method 
using processes running on a server interface processor and 
processes running on disk node processing units, the method 
comprising the steps: 

(a) receiving by the processes running on the server 
interface processor storage, access and processing 
requests from a client process; 

(b) decomposing file storage, access and processing 
requests into a plurality of access, storage and process- 
ing requests executable by processes running on disk 
node processors: 

(c) sending said plurality of access, storage and process- 
ing requests to processes running on disk node proces- 
sors: 

(d) receiving in parallel said plurality of access, storage 
and processing requests by processes running on disk 
node processors: 

(e) executing in parallel said plurality of requests includ- 
ing an operation selected from the group of geometric 
transformations and image processing operations by 
accessing disk data on a plurality of disks and by 
applying processing operations executed by processes 
running on a plurality of processors: 

(f) assembling the results obtained by the parallel execu- 
tion of said requests into one result; and 

(g) returning said result to the requesting client process. 

15. A parallel file storage, access and processing method 
of claim 14, where processes running in a server interface 



operable for receiving service requests from computers, 55 processor comprise a server interface process and at least 



further operable for analyzing, processing and decom- 
posing service requests into storage, access and pro- 
cessing cornmands and further operable for transmit- 
ting them to said disk node processors which are 
operable for receiving commands, further operable for 
executing commands including an operation selected 
from the group of geometric transf ormations and image 
processing operations and further operable for return- 
ing results. 

9. A rmiroprocessor multidisk storage server of claim 8, 
where the interconnection network between the server inter- 
face and the disk nodes comprises a crossbar switch. 
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one file server process and where processes running on disk 
node processing units comprise extent server processes, said 
server interface process being responsible for receiving file 
storage, access and processing requests and for transmitting 
file creation, opening and closing requests to the file server 
process and for transmitting file access requests to the extent 
server processes, said file server process being responsible 
for interacting with the extent server processes for creating 
new file entries in a file directory and in a distribution index 
block table, said distribution index table comprising file 
dimensionality information, file size information and file 
extent size information and comprising, for each disk on 
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which a file is stored, a pointer to its file local extent table, 
said file local extent table comprising for each locally stored 
extent of a file the address of its starting block and its 
effective extent size. 

16. A parallel file storage, access and processing method 
of claim 14. where files are multidimensional files made of 
elementary elements, each element being composed of at 
least one byte, where multidimensional files arc segmented 
into multidimensional extents, where extents are incremen- 
tally numbered as is shown in the case of the following 
3-dimensional extent positioned as the i A extent in the x 
direction, thej* extent in y direction, and the k* extent in z 
direction according to the formula: 
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ExtcatNumbe<ij^)^*<NbOffltt^^ 
j »NbOfEi tra hlnX+i, 

wherein extents are striped into a set of available d disks 
according to the following formula: 

DiskNumbef^teotNumber>Ata3tNitml» MODULO d, 

where NbOfExtcntsInX and NbOfExtentsInY are the num- 
ber of extents required to cover respectively the width 
(x-axis) and the height (y-axis) of one plane of the consid- 
ered 3-d pixmap image. 

17. A multiprocessor parallel file system operable for 
storing and accessing in parallel data files striped onto 
multiple disks, said data files being striped onto the disks 
according to their dimensionality which ranges from 1 to 3, 
the multiprocessor parallel file system comprising: 

(a) a file server process operable for receiving file 
creation, opening and closing requests and operable for 
interaction with extent server processes regarding the 
creation and deletion of directory entries and distribu- 
tion information block table entries; 

(b) extent server processes running on disk node proces- 
sors operable for receiving file extent storage and 
access requests and for receiving from the file server 
process commands for the creation and deletion of 
directory entries and distribution information block 
table entries; and 

c) parallel file system interface library procedures for file 
creation, file opening, file access and file closing. 

18. A parallel file system of claim 17, where as a means 
for efficient parallel file access, the size of the extents striped 
onto the disk at storage time is computed by varying the 
extent width so as to make the offset between the respective 
disk numbers of an extent lying one extent row below 
another extent prime in respect to the number of disks. 

19. A miiltiprocessor-inaltku^ storage server offering 
parallel file storage, access, and processing functions com- 
prising: 

(a) a server interface processor connected by a commu- 
nication means to at least one computer, said server 
interface processor being operable for receiving service 
requests from computers, further operable for 
analyzing, processing and decomposing service 
requests into storage, access and processing commands 
and further operable for transmitting mem to disk node 
processors; 

(b) disk nodes, said disk nodes each comprising a disk 
node processor and at least one disk, said disk node 
processor being operable for receiving commands, fur- 
ther operable for executing processing commands com- 
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prising operations selected from the group of geometric 
transformations and image processing operations; 
(c) an interconnection network : between said server inter- 
face and disk nodes. 

20. A multiprocessor parallel file system operable for 
storing, accessing and operating in parallel on data files 
striped onto multiple disks, the multiprocessor parallel file 
system comprising: 

(a) a file server process operable for receiving file 
creation, opening and closing requests and operable for 
communicating with extent server processes regarding 
the creation and deletion of directory entries and dis- 
tribution information block table entries; 

(b) extent server processes running on disk node proces- 
sors operable for receiving file extent storage and 
access requests and for receiving from the file server 
process commands for the creation and deletion of 
directory entries and of distribution information block 
table entries; 

(c) operation slave processes running on disk node pro- 
cessors operable for receiving file reading commands 
and file operation commands, for executing them and 
for returning results; 

(d) an operation master process operable for receiving file 
access and file operating requests, operable for decom- 
posing said file access and file operating requests into 
file reading commands and into file operating . 
commands, for transmitting said commands to opera- 
tion slave processes and for receiving the results from 
said operation slave processes; 

(e) a server interface process running on a server interface 
processor, the server interface process being operable 
for receiving service requests from client computers, 
further operable for analyzing, processing and decom- 
posing service requests into file storage, access and file 
operating commands and for transmitting them to the 
file server, extent server and operation master pro- 
cesses. 

21. A rmUtiprocessOT-multidisk storage sever offering 
parallel file storage, access, and processing functions com- 
prising: 

(a) a server interface comprising at least one local pro- 
cessor connected by a communication means to at least 
one computer, 

(b) disk nodes, said disk nodes each comprising a disk 
node processor and at least one disk, said disk being 
operable for storing data; 

(c) an interconnection network between said server inter- 
face and disk nodes whereby said server interface is 
operable for receiving service requests from computers, 
further operable for analyzing, processing and decom- 
posing service requests into storage, access and pro- 
cessing commands and further operable for transmit- 
ting them to said disk node processors which are 
operable for receiving commands, further operable for 
executing commands and further operable for returning 
results; and where service requests from remotely 
located client computers comprise: 

(A) file storage and access requests, where the dime- 
rionality of the file is selected from The group of 
1-dimension, 2-dimensions and 3 -dimensions and 
where extents arc striped onto the disks at file storage 
time according to The dimensionality of the file; 

(B) file transformation and processing requests; 
wherein: 

(i) file storage and access requests comprise file 
creating, opening, anu\deleting commands and file 



04/20/2004, EAST version: 1.4.1 



5,737,549 



17 



18 



extent storage and access commands executed in 
parallel by disk node processors; 
(ii) file transformation and processing requests are 
decomposed into file part transformation anti pro- 
cessing operations executed in parallel by disk 5 
node processors. 

22. A multiprocessor multidisk storage server of claim 21 
where service requests further comprise: 

(a) redundancy file creation requests; 

(b) file recovery requests; wherein 10 

(i) redundancy file creation requests are executed by 
generating from data file extents parity file extents 
which are stored on different disks from the disks 
storing the corresponding data file extents; 

(ii) file recovery requests in the case of single disk 15 
crashes are executed by reading valid data extents 
from the file robe recovered and redundant parity 
extents from its corresponding redundancy file, by 
computing the lacking data extents and by writing 
the recovered file on valid disks. 20 

23. A multiprocessor multidisk storage server of claim 21 
where, as a means for efficient parallel file access, the size 
of the extents striped onto the disk at storage time is 
computed by varying the extent width so as to make the 
offset between the respective disk numbers of an extent lying 25 
one extent row below another extent prime in respect to the 
number of disks. 

24. A parallel fie storage, access and processing method 
using processes running on a server interface processor and 
processes running on disk node processing units, the method 30 
comprising the steps of: 

(a) receiving by the processes running on the server 
interface processor storage, access and processing 
requests from a client process; 

(b) decomposing file storage, access and processing 
requests into a plurality of access, storage and process- 
ing requests executable by processes running on disk 
node processors; 

(c) sending said plurality of access storage and processing ^ 
requests to processes running on disk nodeiprocessors; 

(d) receiving in parallel: said plurality of access, storage 
and processing requests by processes running on disk 
node processors; 

(e) executing in parallel said plurality of requests by 45 
accessing disk data on a plurality of disks and by 
applying processing operations executed by process as 
running on a plurality of processors; 

(0 assembling the results obtained by the parallel execu- 
tion of said requests into one result; so 

(g) returning said result to the requesting client process, 
wherein 

(i) files are composed of extents, each extent compris- 
ing at least one elementary element, each elementary 
dement being composed of at least one byte;, 55 

(ii) decomposing file storage, access and processing 
requests comprises the operations of segmenting 
files into extents; 

(iii) the processing operations executed by processes 
running on a plurality of processors comprise an 60 
operation selected from the group of geometric trans- 
formations and image processing operations. 

25. A parallel file storage, access and processing method 
of claim 24, where multidimensional files are segmented 
into multidime nsional extents, where extents are incremen- 65 
tally numbered as is shown in the ease of the following 
3-dimensional extent positioned as the t* extent in the x 



35 



direction, the J* extent in y direction, and the k* extent in 
z direction according to the formula: 



ExtentNumbertfj,k)^(NO£fote^ 
j*NbOffixtentsInX+i, 

wherein extents are striped into a set of available d disks 
according to the following formula 

DiskNumbei<ExtentNuinber)=ExtentNun^ MODULO 
d, 

where NbOfBxtentsInX and NbOfExtentsInY are the num- 
ber of extents required to cover respectively the width 
(x-axis) and the height (y-axis) of one plane of the consid- 
ered 3-d pixmap image. 

26. A multiprocessor parallel file system operable for 
storing, accessing and processing in parallel data files 
striped onto multiple disks, said data files being striped onto 
the disks according to their dimensionality which ranges 
from 1 to 3, the multiprocessor parallel file system com- 
prising: 

(a) a file server process operable for receiving file 
creation, opening, closing and processing requests and 
operable for interaction with extent serve processes 
regarding the creation and deletion of directory entries 
and distribution information block table entries; 

(b) extent server processes running on disk node proces- 
sors operable for receiving file extent storage, access 
and processing operations requests and for receiving 
from the file server process commands for the creation 
and deletion of directory entries and distribution infor- 
mation block table entries; 

(c) parallel file system interface library procedures for file 
creation, file opening, file access and file closing; 
wherein 

(i) data files are composed of extents, each extent 
comprising at least one elementary element each 
elementary element being composed of at least one 
byte: 

(ii) the processing operations executed by extent server 
processes running on a plurality of processors com- 
prise an operation selected from the group of geo- 
metric transformations and image processing opera- 
tions. 

27. A parallel file system of claim 24, where data files are 
midtidirnensional files segmented into multidimensional 
extents, where extents are incrementally numbered as is 
shown in the case of the following 3-dimensional extent 
positioned as the i* extent in the x direction, the j* extent 
in y direction, and the k* extent in z direction according to 
the formula 



BateriNumbc<^)=MNbOffi¥ir^ 
j*NbOfflitentslnX+i, 

wherein extents are striped into a set of available d disks 
according to the following formula 



DifikNumber(BxteQtHumiOT MODULO d, 

where NbOfBxtentsInX and NbOfExtentsInY are the num- 
ber of extents required to cover respectively the width 
(x-axis) and the height (y-axis) of one plane of the consid- 
ered 3-d pixmap image. 

28. A multiprocessor parallel file system operable for 
storing, accessing and operating in parallel on data files 
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striped onto multiple disks, the multiprocessor parallel file (iii) file operation commands comprise an operation 

system comprising: selected from the group of geometric transforma- 

(a) a file server process operable for receiving file tions and image processing operations^ 
creation. orx,ning^closm7requests and operable for ^. AparaUelfile storage and processing method offemg 
comrnuoicalng with extent scr^e processes regarding 5 

the creation and deletion of directory entries and dis- striped on a plurality of disks, comprising file creation, fik 

Sbution information block tables; reading, file writing, and file processing functions whereby 

J . J storage, access and processing requests are sent by client 

(b) extent server ^ocesses running on disk node proces- locflted me scrvef , received by a server 
sors operable for receiving file extent storage and ^ f Qt£rfacc s located on me server interface processor, 
access requests and for receiving from the file server md decomposed into requests directed to a file 
process commands for the creation and deletion of ^ s to cxtent ^ processes and to operation 
directory entries and of distribution information block ^ where Ues m multidimensional files made of 
table entries; elementary elements, each element being composed by one 

(c) operation slave processes running on disk node pro- l3 ^ morc bytcs w hcrein multidimensional files are seg- 
cessors operable for receiving file reading commands men ted into rnultidimensional extents, wherein extents are 
and file operation commands, for executing them and incrementally numbered as is shown in the case of the 
for returning results; following 3-dimensional extent positioned as the h* extent 

(d) an operation master process operable for receiving file in the x direction, the J* extent in y direction, and the* 
access and file operating requests, operable for decern- 20 extent in z direction according to the formula 

posing said file access and file operating requests into 
reading commands and into operating commands, for 

transmitting said commands to operation slave pro- ExttatNumberft£)^*(^^ 

cesses and for receiving the results from said operation j*NbOExtcnt*inX>i t 
slave processes; and 25 

(e) a server interface process running on a server interface wherein extents are striped into a set of available d disks 
processor, the server interface process being operable according to the following formula 

for receiving service requests from client computers, DiskNumbc^tentNumb^ MODULO 

further operable for analyzing, processing and decom- d 

posing service requests into file storage, access and file 30 ^^VtoOfExtentsInX and NbOjExtentsInY are the num- 

opcrating commands and for transmitting them to the ^ of ^ to ^ respectively the width 

file server, extent server and operation master pro- (Mxis)ai|d mc hdght (y^) of one plane of the consid- 

cesses; wherein: ered 3^ mxmap image. 

(i) data files are composed of extents, each extent F ~T^7^ ^ ^ • 1 • 
comprising at least ^e elementary element each 35 30. A parallel file storage and processing method m claim 
elementary element being composed of at least one » where storage, access and processing of data files striped 
bvte . on a plurality of disks. 

(ii) decomposing file access requests comprises the 

operation of segmenting files into extents; and * * * * * 
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